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Abstract. We perform Markov chain Monte Carlo simulations for a 
Bayesian inference of the GJR-GARCH model which is one of asymmet- 
ric GARCH models. The adaptive construction scheme is used for the 
construction of the proposal density in the Metropolis-Hastings algo- 
rithm and the parameters of the proposal density are determined adap- 
tively by using the data sampled by the Markov chain Monte Carlo simu- 
lation. We study the performance of the scheme with the artificial GJR- 
GARCH data. We find that the adaptive construction scheme samples 
GJR-GARCH parameters effectively and conclude that the Metropolis- 
Hastings algorithm with the adaptive construction scheme is an efficient 
method to the Bayesian inference of the GJR-GARCH model. 
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1 Introduction 

Price returns of financial assets such as stock indexes, exchange rates show var- 
ious interesting properties which can not be derived from a simple assumption 
that the price returns follow the geometric Brownian motion. Those properties 
are now classified as stylized facts |l|2j . Typical examples of the stylized facts are 
(i) fat-tailed distribution of return (ii) volatility clustering (iii) slow decay of the 
autocorrelation time of the absolute returns. 

In empirical finance the volatility is an important quantity to measure risk. In 
order to forecast future volatility it is important to make models which mimic 
the properties of the volatility. The most successful model is the Generalized 
Autoregressive Conditional Heteroscedasticity (GARCH) model by Engle[3] and 
Bollerslev|4 , which can capture the property of volatility clustering and shows 
fat-tailed distributions. 

In the original GARCH model 03], the volatility process is symmetric un- 
der positive and negative observations. However the volatility often shows higher 
response against negative shocks, which was first observed by Black[5J. This phe- 
nomenon is called the leverage effect. In order to incorporate this asymmetry ef- 
fect into the model, some extended GARCH models have been proposed 6 7 819110111] . 
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In this study we use the GJR-GARCH model by Glosten et aL[7] which intro- 
duces the asymmetry into the volatility process by an artificial indicator function. 

In order to infer model parameters from financial data we employ Markov 
Chain Monte Carlo (MCMC) methods based on the Bayesian inference. Since 
there is no unique way to implement the MCMC scheme various MCMC methods 
for the GARCH models have been proposed [H|13I14I15I16I17I18I19| . In a survey 
on the MCMC methods of the GARCH models [T7] it is shown that Acceptance- 
Rejection/ Metropolis-Hastings (AR/MH) algorithm works better than other 
algorithms. In the AR/MH algorithm the proposal density is assumed to be a 
multivariate Student's t-distribution and the parameters to specify the distri- 
bution are estimated by the Maximum Likelihood (ML) technique. Recently an 
alternative method to estimate those parameters without relying on the ML tech- 
nique was proposed |20|21|22] . In the method the parameters are determined by 
using the data generated by an MCMC method and updated adaptively during 
the MCMC simulation. We call this method " adaptive construction scheme" . 

The adaptive construction scheme was tested for GARCH and QGARCH 
models [20121122] and it is shown that the adaptive construction scheme can 
significantly reduce the correlation between sampled data. In this study we apply 
the adaptive construction scheme to the GJR-GARCH model and study the 
efficiency of the adaptive construction scheme. 

2 GJR-GARCH Model 

The GJR-GARCH model[7] is given by 

Vt = (r t e t , (1) 

of = uj + ay\_ x + \{l yt _ 1 <o}y' 2 t^ 1 + fot-i, ( 2 ) 

where e t is an independent normal error ~ iV(0, 1) and yt are observations. 
The indicator function l 1/t _ 1 <o is 1 if yt-i < 0, and otherwise 0. This indicator 
function introduces the asymmetry in the time series and it generates higher 
volatilities after negative shocks than positive ones. 

3 Bayesian inference 

Using the Bayes' rule the posterior density Tt{9\y) with n observations y — 
{Vi,V2,-- -,y n ) is given by 

tt(%) cx L(y\9)n(9), (3) 

where L(y\9) is the likelihood function. ir(8) is the prior density for 9. The 
functional form of ir(9) is not known a priori. In this study we assume that the 
prior density n(9) is constant. 

The likelihood function for the GJR-GARCH model is given by 

L{y\6)=nU n ^™v{-A\ (4) 
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where = (a,(3,ui,A) stands for the GJR-GARCH parameters, erf is given by 
eq.©. 

Using Tr(0\y) the GJR-GARCH parameters are inferred as the expectation 
values given by 

(0) = \ J 0n(e\y)d0, (5) 

where Z — J n(0\y)d9 is a normalization constant irrelevant to MCMC estima- 
tions. 

3.1 Markov Chain Monte Carlo 

In general it is difficult to evaluate eq.© analytically. The MCMC technique 
gives a method to estimate eq.© numerically. The basic procedure of the MCMC 
method is as follows. First we sample 9 drawn from a probability distribution 
n(0\y). Sampling is done by a technique which produces a Markov chain. After 
sampling some data, we evaluate the expectation value as an average value over 
the sampled data 0W ) 

W= lim tE# W , (6) 

i=l 

where k is the number of the sampled data. The statistical error for k inde- 
pendent data is proportional to In general, however, the data generated 
by the MCMC process are correlated. As a result the statistical error will be 
proportional to \J^- where r is the autocorrelation time among the sampled 
data. 



3.2 Metropolis-Hastings algorithm 



The MH algorithm (2"1| is a generalized version of the Metropolis algorithm 23 . 
Let us consider to generate data x from a probability distribution P(x). The 
MH algorithm consists of the following steps. First starting from x, we propose a 
candidate x' which is drawn from a certain probability distribution g(x'\x) which 
we call proposal density. Then we accept the candidate x' with a probability 
Pmh(x, x') as the next value of the Markov chain: 



Pmh{x 7 x') = min 



P(x')g(x\x') 



P{x) g{x'\x) 



(7) 



If x' is rejected we keep the previous value x. We repeat these steps. 

When the proposal density does not depend on the previous value, i.e. g(x\x') 
g(x) we obtain 

P(x') g(x) 



MH 



(x, x ) = min 



1. 



P(x) g(x>) 



(8) 



4 Tetsuya Takaishi 



4 Adaptive construction scheme 



The efficiency of the MH algorithm depends on how we choose the proposal 
density. By choosing an adequate proposal density for the MH algorithm one 
can reduce the correlation between the sampled data. The posterior density of 
GARCH parameters often resembles to a Gaussian-like shape. Thus one may 
choose a density similar to a Gaussian distribution as the proposal density. Such 
attempts have been done by Mitsui, WatanabefTB] and Asai[T7]. They used a 
multivariate Student's t-distribution in order to cover the tails of the poste- 
rior density and determined the parameters to specify the distribution by using 
the ML technique. Here we also use a multivariate Student's t-distribution but 
determine the parameters through MCMC simulations. 

The (p-dimensional) multivariate Student's t-distribution is given by 



r(( v + P )/2)/r(v/2) 

det r 1 /2( z , 7r ) P /2 

(0- M) t S- 1 {9 



M) 



-0+p)/2 



(9) 



where 9 and M are column vectors, 





"0f 




'Mi 




02 










,M = 






dp _ 




_M p _ 



(10) 



and Mi = E(9i). £ is the covariance matrix defined as 



-— = E[(9-M)(e-M) t }. (11) 

v is a parameter to tune the shape of Student's t-distribution. When v — > oo the 
Student's t-distribution goes to a Gaussian distribution. At small v Student's 
t-distribution has a fat-tail. Since eq. © is independent of the previous value of 
9, eq.© is used in the MH algorithm. 

For the GJR-GARCH model, p = 4, 9 = (0i,0 2 ,03,0i) = [a,0,u,\), and £ 
is a 4 x 4 matrix. The unknown parameters in M and £ are determined by using 
the data obtained from MCMC simulations. First we make a short run by the 
Metropolis algorithm and accumulate some data. Then we estimate M and £. 
Note that there is no need to estimate M and £ accurately. Second we perform 
an MH simulation with the proposal density of eq. ((9]) with the estimated M and 
£. After accumulating more data, we recalculate M and £, and update M and 
£ of eq.® - By doing this, we adaptively change the shape of eq.© to fit the 
posterior density. 
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5 Numerical Study 

In this section we study the performance of the adaptive construction scheme by 
using artificial GJR-GARCH data generated with known parameters. The GJR- 
GARCH parameters are set to a = 0.03, = 0.85, w = 0.05 and A = 0.1. We 
have generated 2000 data by the GJR-GARCH process with these parameters. 
FigQ] shows the time series of the 2000 data. 




time 



Fig. 1. The artificial times series generated by the GJR-GARCH process with 
a = 0.03, $ = 0.85, lu = 0.05 and A = 0.1. 

The MCMC method with the adaptive construction scheme is implemented 
as follows. First we make a short run by a standard Metropolis algorithm. The 
first 5000 data are discarded as burn-in process or thermalization. Then we 
accumulate 1000 data for M and E estimations. The estimated M and S are 
substituted to g(0). In this study we take v = 10. We re-start a run by the MH 
algorithm with g{9). Every 1000 updates we re-calculate M and £ and update 
g{9). We accumulate 100000 data for analysis. 

For comparison we also use a standard Metropolis algorithm to infer the 
GJR-GARCH parameters and accumulate 100000 data for analysis. In this study 
the Metropolis algorithm is implemented as follows. We draw a candidate 9' by 
adding a small random value 59 to the present value 9: 

9' = 9 + 59, (12) 

where 59 = d(r — 0.5). r is a uniform random number in [0, 1] and d is a constant 
to tune the Metropolis acceptance. We choose d so that the acceptance becomes 
greater than 50%. 

The results of the parameters inferred by the MH algorithm with the adaptive 
construction scheme and the Metropolis algorithm are summarized in Table 1. 
We see that both algorithms well reproduce the values of the input parameters 
within the standard deviation. Furthermore the obtained values and the standard 
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Fig. 2. Monte Carlo history of a from the MH algorithm with the adaptive 
construction scheme(left) and the Metropolis algorithm(right). 

Table 1. Results of GJR-GARCH parameters. SD and SE stand for standard 
deviation and statistical error respectively. 












A 


true 


0.03 


0.85 


0.05 


0.1 


Adaptive 


0.03285 


0.85540 


0.04522 


0.08719 


SD 


0.0015 


0.040 


0.019 


0.026 


SE 


0.00011 


0.00025 


0.00011 


0.00066 


2r 


2.8 ±0.2 


3.3 ±0.7 


4.6 ± 0.8 


2.6 ± 0.2 


Metropolis 0.0323 


0.855 


0.0454 


0.0895 


SD 


0.0015 


0.038 


0.018 


0.026 


SE 


0.0007 


0.004 


0.0018 


0.0015 


2r 


320 ± 100 1050 ± 350 990 ± 330 350 ± 110 



deviations from both algorithms coincide well each other. This observation is not 
surprising because both algorithms are performed using the same artificial data 
and thus the posterior density is the same for both. 

FigH] shows Monte Carlo time histories of the sampled a from the adaptive 
construction scheme (left) and Metropolis algorithm(right). We see that the data 
sampled by the Metropolis algorithm are substantially correlated. The similar 
behavior is also seen for the sampled data for other parameters. 

The correlations between the data can be measured by the autocorrelation 
function (ACF). The ACF of certain successive data is defined by 

ACF[t) = -<«>)<*"■>-<«» (13) 

a e 

where (9) and <jg are the average value and the variance of respectively. 

Fig|3]compares the ACF of a sampled from the adaptive construction scheme (left) 
and the Metropolis algorithm(rigth). The ACF of the adaptive construction 
scheme decreases quickly as Monte Carlo time increases. On the other hand 
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the ACF of the Metropolis algorithm decreases very slowly, which indicates that 
the correlation between the sampled data is very large. 




10 20 30 40 1000 2000 

t t 



Fig. 3. Autocorrelation function of a sampled by the adaptive construction 
scheme(left) and the Metropolis algorithm(right). 



To quantify the correlation between the data we calculate the autocorrelation 
time (ACT) t defined by 

1 °° 

i=l 

2t is also called "inefficiency factor" . Results of r are summarized in Table 1. We 
find that the ACT from the adaptive construction scheme have much smaller r 
than those from the Metropolis simulations. For instance r of a parameter from 
the adaptive construction scheme is decreased by a factor of 100 compared to 
that from the Metropolis algorithm. Furthermore the values of r are about 2 — 3 
which are similar to the results of the AR/MH algorithm [16U7j . These results 
prove that the adaptive construction scheme is an efficient algorithm for sampling 
de-correlated data. The differences in r also explain that the statistical errors 
from the adaptive construction scheme are much smaller than those from the 
Metropolis simulations. 

FigH] shows the convergence property of the diagonal and off-diagonal ele- 
ments of the covariance matrix V. Here V is defined by V = E[(9 — M){6 — M) ]. 
We see that all the diagonal elements of V quickly converge to certain values as 
the simulations are proceeded. 

Fig[5] shows the acceptance at the MH algorithm with the adaptive proposal 
density of eq.©. Each acceptance is calculated every 1000 updates and the 
calculation of the acceptance is based on the latest 1000 data. Surprisingly at 
the first stage of the simulation the acceptance already reaches a plateaus of 
about 70%. This indicates that the accuracy of the parameters of the proposal 
density are high enough for the MH algorithm already at the first stage. 
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Fig. 4. The diagonal (left) and off-diagonal(right) elements of V as a function 
of the data size. 
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Fig. 5. Acceptance at MH step with the adaptive proposal density. 



6 Conclusions 

We have performed the MCMC simulations of the Bayesian inference on the 
GJR-GARCH model which is one of asymmetric GARCH models. The MCMC 
was implemented by the MH algorithm with the Student's t-distribution and 
the parameters of the Student's t-distribution were updated adaptively during 
the simulations. The autocorrelation times of the data sampled by the adaptive 
construction scheme are found to be very small. The obtained values of r are sim- 
ilar to those of the AR/MH algorithm in |16|17j . Thus the adaptive construction 
scheme has the similar efficiency with the AR/MH algorithm. It is concluded 
that the adaptive construction scheme is also an efficient MCMC technique for 
the Bayesian inference of the GJR-GARCH model. The previous studies on the 
GARCH and QGARCH models [2"D|21I22] also reached the same conclusion. 
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It is also found that the acceptance of the MH algorithm quickly reaches a 
plateau of about 70% at the beginning of the simulation. This indicates that the 
parameters of the Student's t-distribution for the MH algorithm are calculated 
precisely enough by using the small data sampled at the beginning of the simu- 
lation. This observation may suggest that one can stop updating the parameters 
at some point of the simulation and use the same proposal density after that. 
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